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DESCRIPTION 



STOCHASTIC PULSE GENERATOR AND ABSOLUTE DIFFERENCE 



PROCESSOR, AND MANHATTAN DISTANCE PROCESSING 
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APPARATUS EMPLOYING THE SAME 



Technical Field 



The present invention relates to a stochastic pulse generator 



operative to stochastically generate pulses, the number of which 
10 corresponds to the magnitude of an analog voltage, an absolute difference 
processor employing the same, and a Manhattan distance processing 
apparatus employing the same. 

Background Art 

15 It is generally considered to be common knowledge in the art so- 

called signal processing that if signals are mixed with noise, the S/N ratio 
becomes worse and the original signals become difficult to obtain. However, 
creatures in the natural world are living while processing signals mixed 
with much noise at very low power consumption. The phenomenon called 

20 "stochastic resonance" has been found as one of important mechanisms of 
such signal processing. The stochastic resonance phenomenon is that in a 
noise -given bistable system there are some cases where the S/N ratio is 
improved contrary to expectation. 



25 to the industries (hereinafter will be referred to as "first conventional art") 
is "METHOD AND APPARATUS FOR DETECTING A SPATIO-TEMPORAL 



One conventional art attempting to apply such a phenomenon 



? 



PATTERN, AND RECORDING MEDIUM" described in Japanese Patent 
Laid-Open Publication No. 2000-3350 for example. 

Fig. 13 illustrates a method of detecting detected signals 
according to the first conventional art. The method described in the first 
5 conventional art is to detect signals mixed with noise using an operation 
method called neural network. 

According to the method illustrated in Fig. 13, first of all, the 
neural network learns a noise-free pattern at steps 101 and 102; thereafter, 
a noise-mixed signal is inputted to the neural network at step 103; further, 
10 stochastic resonance is caused to occur at step 104; and, thereafter, Fourier 
transformation is performed to find a characteristic frequency peak at step 
106, thereby finding the frequency of the original signal from the noise- 
mixed signal. 

The detection method of the first conventional art, however, 
15 does not disclose any definition of what in the world the "noise" is. For 
example, when noise contains an intensive frequency component, this 
component is undesirably analyzed at the final frequency peak detection 
step, thus resulting in a problem of inaccurate detection. 

Meanwhile, with the recent widespread use of personal 
20 computers (PCs), semiconductor devices also find home use significantly 
widely and hence find increasing personal uses not only for simple 
numerical operations but also for Internet, mail, image processing and the 
like. 

However, PCs, which have become capable of such high-speed 
25 processing, cannot perform all operations at sufficient speed. For example, 
such processing as to recognize human voices or languages or identify a 



person on camera requires an enormous amount of operations. For this 
reason, realtime processing is difficult. 

Such recognition processing is based on processing including* 
vectorizing stored information on voices or faces for example into reference 
vectors to be stored* likewise, vectorizing inputted information into an 
inputted vector,* detecting similarities between the inputted vector and each 
of the reference vectors,* and performing an operation to find which of the 
reference vectors is most proximate to the inputted vector. Such vector 
comparison processing is fundamental processing that can be utilized in a 
wide variety of information processing including associative storage, 
quantization of vectors, pattern recognition for motion prediction for 
example, and data compression. 

Such vector comparison requires a massive amount of 
operations in any application. Further, von Neumann type computers, 
representative of which are PCs, cannot extract the most proximate vector 
until all vector comparison operations have been completed because of their 
operating principle and, as a result, extraction of the most proximate vector 
requires a very long time. 

A conventional device (hereinafter will be referred to as "second 
conventional art") based on a new concept for computing the "proximity" 
between plural numeric values (between a set of numeric values and 
another set of numeric values) at higher speed is described in, for example, 
"A CMOS Stochastic Associative Processor Using PWM Chaotic Signals", 
IEICE Transactions on Electronics, Vol. E84-C, No. 12, December 200, 
pp. 1723 1729. 

Fig. 34 illustrates the configuration of a distance processing 
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apparatus according to the second conventional art. 

The distance processing apparatus shown in Fig. 34 is an 
apparatus for stochastically processing the match/mismatch between digital 
data. When input data 101 matches with stored data 103 (both of the two 
5 are 1 or 0), XNOR circuit 120 outputs 1. To the output side of the XNOR 
circuit 120 is connected PWR chaos generator 121 for varying the pulse 
width chaotically. When latch signal 105 is inputted to latch circuit 122 
after a certain time period after PWAM chaos has been generated, the value 
inputted at that time is held. Since the signal having a chaotically variable 

10 width is inputted to the latch circuit 122, an operation by which the value 
held by the latch circuit 122 becomes High is a stochastic operation. When 
High is held, switch 109 is turned ON to feed current from current source 
107. By detecting the total sum of such currents and then performing 
comparison by high-order value extraction circuit 111, the sum of currents 

15 detected becomes stochastically larger as a group of input data 101 and a 
group of stored data 103 become more proximate to each other. Thus, the 
proximity between vectors (a humming distance in this case) can be 
calculated stochastically. Note that the second conventional art uses so- 
called logistic chaos as shown in the map of Fig. 35. 

20 However, the distance processing apparatus of the second 

conventional art can only perform comparison between two values since the 
apparatus compares digital information. This means that the apparatus, 
as it is, operates only as a humming distance processing apparatus. 
Therefore, in comparing multiple-bit information the apparatus needs to 

25 perform comparisons between two values a number of times corresponding 
to the number of bits. This is not efficient. 
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Further, because the comparison of binary information (i.e., 
distance processing) is completed by XNOR, the introduction of chaos 
thereafter to obtain a chaotic solution is disadvantageous in terms of energy 
efficiency. Thus, the distance processing apparatus which processes digital 
5 information only cannot be expected to operate at reduced energy 
consumption. 

Disclosure of Invention 

A first object of the present invention is to provide a processor 
10 capable of extracting a frequency component of an original signal from a 
noise-containing signal. 

A second object of the present invention is to provide a processor 
capable of processing a Manhattan distance while reducing energy 
consumption. 

15 As a result of study to attain these objects, the inventor of the 

present invention have found that it is very important to control a random 
signal which is described as noise in the conventional art in applications of 
stochastic resonance to the industries. As a device embodying this idea and 
attaining the first object, the inventor has invented a stochastic pulse 

20 generator capable of controlling the pulse generation probability to a desired 
probability. 

The inventor has further found that by the use of this stochastic 
pulse generator the second object to provide a processor capable of 
processing a Manhattan distance while reducing energy consumption can be 
25 attained. 

That is, a stochastic pulse generator according to the present 
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invention comprises a variable signal generator operative to generate a 
variable signal which varies randomly, and a comparator operative to output 
a binary signal of High or Low depending on which of one input signal and 
another input signal is larger or smaller than the other, wherein when the 
5 variable signal is inputted as said one input signal to the comparator from 
the variable signal generator, the comparator stochastically outputs pulses, 
the number of which corresponds to a magnitude of said another input 
signal. 

The variable signal generator may be operative to generate, as 
10 the variable signal, a control random signal statistically having a histogram 
in terms of its magnitude and a statistical histogram of the pulses is 
controlled based on a distribution of the histogram of the control random 
signal. 

Said another input signal may contain at least a periodic signal 
15 as a component thereof. 

It is possible that the variable signal generator has a storage 
device and is operative to generate the control random signal by 
digital/analog conversion of random number digital data having a 
predetermined histogram stored in the storage device. 
20 The random number digital data having the predetermined 

histogram may be obtained by an inverse transformation method or a 
rejection method. 

It is possible that- the control random signal contains a 
frequency component higher than a frequency band of the periodic signal 
25 contained in said another input signal; the pulse generator has a low-pass 
filter for blocking a frequency band higher than the frequency band of the 
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periodic signal; and the pulses outputted from the comparator are inputted 
to the low-pass filter. This arrangement can enhance the periodic signal 
detectability. 

The variable signal generator may be operative to generate a 
5 random variable signal having a histogram becoming uniform in at least an 
infinite time. With this arrangement, the pulse generation probability is 
rendered linear relative to the another input signal. 

The variable signal may be chaos of a tent map. 
The variable signal may be chaos of a Bernoulli shift map. 
10 The variable signal may be uniform random numbers. 

The comparator may be an analog comparator. 
The comparator may be a chopper type CMOS comparator. 
It is possible that said another input signal is inputted to and 
held by the chopper type CMOS comparator and then the variable signal is 
15 inputted to the chopper type CMOS comparator subsequently. 

An absolute difference processor according to the present 
invention comprises" first and second stochastic pulse generators each 
comprising a stochastic pulse generator as recited in claim l; and an 
exclusive-OR circuit for outputting an exclusive-OR of an output of the first 
20 stochastic pulse generator and an output of the second stochastic pulse 

generator; wherein when said another input signal and the variable signal 
which are inputted to the first stochastic pulse generator are Vsi and Vci, 
respectively, while the output of the first stochastic pulse generator is Voi 
and; said another input signal and the variable signal which are inputted to 
25 the second stochastic pulse generator are Vs2 and Vc2, respectively, while 
the output of the second stochastic pulse generator is V02, the variable 
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signals Vci and Vc2 are the same variable signal- thereby obtaining an 
absolute difference between the value of said another input signal Vsi and 
that of said another input signal Vs2 in the form of a number of stochastic 
pulses comprising the exclusiveOR. 
5 The stochastic pulses comprising the exclusive-OR may be 

generated with a pulse generation probability which lowers with decreasing 
absolute difference between the value of said another input signal Vsi and 
that of said another input signal Vs2. 

The variable signals Vci and Vc2 may be generated to repeat 

10 the same progression. 

A Manhattan distance processing apparatus according to the 
present invention comprises a plurality of absolute difference processors as 
recited in claim 14 which are connected in parallel with the single variable 
signal generator, wherein signals corresponding to elements of respective of 

15 two vectors each having the elements, a number of which corresponds to the 
number of the absolute difference processors, are inputted as said another 
input signal Vsi and said another input signal Vs2 to each of the absolute 
difference processors, thereby obtaining a Manhattan distance between the 
two vectors in the form of number of stochastic pulses. This configuration 

20 is capable of preventing inversion of a Manhattan distance operation which 
would otherwise occur due to stochastic generation of pulses. 

A stochastic pulse generator driving method according to the 
present invention is a driving method for a stochastic pulse generator 
including a comparator operative to output a binary signal of High or Low 

25 depending on which of one input signal and another input signal is larger or 
smaller than the other, the method comprising inputting a randomly 
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variable signal as said one input signal to the comparator to cause the 
comparator to stochastically output pulses, the number of which 
corresponds to a magnitude of said another input signal. 

The foregoing and other objects, features and advantages of the 
5 present invention will become apparent from the following detailed 

description of the preferred embodiments to be read with reference to the 
accompanying drawings. 

Brief Description of Drawings 
10 Fig. 1 is a circuit diagram showing the configuration of a 

stochastic pulse generator according to embodiment 1 of the present 
invention. 

Fig. 2 is a graph plotting a characteristic of a comparator of the 
stochastic pulse generator shown in Fig. 1. 
15 Fig. 3 is a circuit diagram showing an example of the 

configuration of an edge detector of the stochastic pulse generator shown in 
Fig. 1. 

Fig. 4 is a graph showing an operation of the edge detector 
shown in Fig. 3. 

20 Figs. 5(a) and 5(b) are graphs showing an operation of the 

stochastic pulse generator shown in Fig. 1. 

Fig. 6 is a schematic diagram for illustrating the pulse 
generation probability of the stochastic pulse generator shown in Fig. 1. 

Fig. 7 is a graph for illustrating an example of obtaining a 
25 control random signal in embodiment 1 of the present invention. 

Fig. 8 is a graph plotting an example of a control random signal 
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generation function in embodiment 1 of the present invention. 

Fig. 9 is a graph showing a signal generation state of a control 
random signal generation function in embodiment 1 of the present invention. 

Figs. 10(a) to 10(c) are each a graph showing a correlation 
between the times of control random signal generation and the frequency of 
control random signal generation. 

Fig. 11 is a circuit diagram showing the configuration of a 
stochastic pulse generator according to embodiment 2 of the present 
invention. 

Fig. 12 includes graphs respectively plotting signal voltage 
waveforms at different parts of the stochastic pulse generator shown in Fig. 
11. 

Fig. 13 is a flowchart of an example of a processing method 
using stochastic pulses according to the first conventional art. 

Fig. 14 is a circuit diagram showing the configuration of a 
stochastic pulse generator according to embodiment 3 of the present 
invention. 

Fig. 15 is a circuit diagram showing the configuration of a 
variable signal generator of the stochastic pulse generator shown in Fig. 14. 

Fig. 16 is a graph showing pulse generation state of the 
stochastic pulse generator shown in Fig. 14. 

Fig. 17 is a graph showing a characteristic of variable signal in 
embodiment 3 of the present invention. 

Fig. 18 is a schematic diagram illustrating the principle of a 
pulse generation probability calculation executed by the stochastic pulse 
generator shown in Fig. 14. 
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Fig. 19 is a schematic diagram illustrating the principle of 
variable signal generation by a stochastic pulse generator according to 
embodiment 4 of the present invention. 

Figs. 20(a) and 20(b) are schematic diagrams illustrating the 
5 principle of a pulse generation probability calculation executed by the 
stochastic pulse generator according to embodiment 4 of the present 
invention. 

Fig. 21 is a graph showing an exact solution to the pulse 
generation probability of the stochastic pulse generator according to 
10 embodiment 4 of the present invention. 

Fig. 22 is a schematic diagram illustrating the principle of 
variable signal generation by a stochastic pulse generator according to 
embodiment 5 of the present invention. 

Figs. 23(a) and 23(b) are schematic diagrams illustrating the 
15 principle of a pulse generation probability calculation executed by the 
stochastic pulse generator according to embodiment 5 of the present 
invention. 

Fig. 24 is a graph showing an exact solution to the pulse 
generation probability of the stochastic pulse generator according to 
20 embodiment 5 of the present invention. 

Fig. 25 is a circuit diagram showing the configuration of a 
stochastic pulse generator according to embodiment 6 of the present 
invention. 

Figs. 26(a) and 26(b) are circuit diagrams for illustrating the 
25 operation of a chopper type CMOS comparator forming part of the stochastic 
pulse generator according to embodiment 6 of the present invention. 
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Figs. 27(a) and 27(b) are circuit diagrams for illustrating the 
operation of the stochastic pulse generator according to embodiment 6 of the 
present invention. 

Fig. 28 is a schematic diagram showing an example of the 
5 operation of the stochastic pulse generator according to embodiment 6 of the 
present invention. 

Fig. 29 is a graph showing a difference resulting from an initial 
value control in the pulse generation probability of a stochastic pulse 
generator according to embodiment 7 of the present invention by 
10 comparison. 

Fig. 30 is a circuit diagram showing an example of the 
configuration of an absolute difference processor according to embodiment 8 
of the present invention. 

Fig. 31 is a graph showing the principle of the operation of the 
15 absolute difference processor shown in Fig. 30. 

Fig. 32 is a graph showing the outcome of the operation of the 
absolute difference processor shown in Fig. 30. 

Fig. 33 is a block diagram showing the configuration of a 
Manhattan distance processing apparatus according to embodiment 9 of the 
20 present invention. 

Fig. 34 is a schematic diagram showing the configuration of a 
distance processing apparatus according to the second conventional art. 

Fig. 35 is a schematic diagram illustrating logistic chaos 
causing a stochastic operation to occur according to the second conventional 
25 art. 
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Best Mode for Carrying Out the Invention 

Hereinafter, embodiments of the present invention will be 
described with reference to the drawings. 
Embodiment 1 

Fig. 1 is a circuit diagram showing an example of the 
configuration of a stochastic pulse generator according to embodiment 1 of 
the present invention. 

In Fig. 1, stochastic pulse generator 1 has a control random 
signal generator 61, a comparator 3, an edge detector 7, and a counter 9. 
Control random signal Vc generated by the control random signal generator 
61 is inputted to the plus input terminal of the comparator 3, while a 
detected signal Vs inputted to the minus input terminal. The comparator 3 
outputs a binary pulse according to the difference of control signal Vc from 
the detected signal. The edge detector 7 detects the leading edge of each 
pulse outputted from the comparator 3 and then outputs pulses of equal 
width. The counter 9 counts the number of pulses outputted from the edge 
detector 7 by detecting, for example, the leading edges of these pulses. 

Detailed description will be made of the configurations of the 
respective components. 

Fig. 2 is a graph plotting the input-output characteristic of the 
comparator 3. The comparator 3 has an input-output characteristic as 
shown in Fig. 2. When a voltage inputted to the plus terminal (i.e., control 
random signal Vc in this embodiment) becomes higher than a voltage 
inputted to the minus terminal (i.e., detected signal Vs in this embodiment), 
output voltage V ou t becomes "High" level (hereinafter will be referred to as 
"High" simply), whereas in the converse case the output voltage V ou t 



14 



becomes "Low" level (hereinafter will be referred to as "Low" simply). That 
is, the output V ou t of the comparator 3 is a binary voltage signal which 
varies like a pulse by at least one up-and-down between High and Low. In 
this embodiment, the output voltage V ou t of High is set to be l[V] and the 
5 output voltage V ou t of Low set to be 0[V]. 

A device called analog comparator may be used as the 
comparator 3. More specifically, an operational amplifier or a latch circuit 
may be used. 

While control random signal Vc and detected signal Vs are 
10 inputted to the plus input terminal and the minus input terminal, 

respectively, of the comparator 3 in this embodiment, it is needless to say 
that a similar operation will result even in a reverse arrangement. 

Fig. 3 is a circuit diagram of an example of the configuration of 
the edge detector 7 shown in Fig. 1. 
15 Referring to Fig. 3, the edge detector 7 has an AND circuit 13. 

To the AND circuit 13 are inputted the output V ou t of the comparator 3 and 
an inverted and delayed output V ou t2 resulting from inversion of the output 
Vout of the comparator 3 and a delay of a predetermined time by a delay 
circuit 11. The AND circuit 13 operates a logical product of the output V ou t 
20 of the comparator 3 and inverted and delayed output V 0 ut2 thus inputted 
thereto and then outputs the resulting logical product as a voltage Vp. 

Figs. 4 (a) and 4(b) are waveform charts showing an operation 
of the edge detector 7 shown in Fig. 3. 

In Fig. 4(a), the output V ou t of the comparator 3 shown by a 
25 solid line is inputted to one input terminal of the edge detector 7, while the 
inverted and delayed output V ou t2 resulting from inversion and delay by a 
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delay time x of the output V ou t of the comparator 3 is inputted to the other 
input terminal as shown by a dashed line. As shown in Fig. 4(b), the AND 
circuit 13 operates a logical product of the output V 0 ut of the comparator 3 
and the inverted and delayed output V ou t2 and then outputs the resulting 
5 logical product of the operation as the output voltage Vp. The output 

voltage Vp becomes High when the output V ou t of the comparator 3 and the 
inverted and delayed output V ou t2 match with each other and becomes Low 
in other cases. It can be understood that in the output voltage Vp a pulse is 
generated at the time when each of pulses of the output V ou t of the 
10 comparator 3 rises (that is, edge (i.e., leading edge) detection is performed), 
while the pulse of the output voltage Vp has a width corresponding to the 
delay time x of the delay circuit 11. The provision of the edge detector 7 
allows the counter 9 shown in Fig. 1 to count the number of generated 
pulses stably. 

15 The control random signal generator 61 includes, for example, a 

processor comprising an LSI and generates a control random signal by 
execution of various operations to be described later for example. Detailed 
description of the control random signal will be made later. 

With reference to Figs. 5(a) and 5(b), description will be made of 

20 the operation of the stochastic pulse generator 1 thus configured. 

Fig. 5(a) is a graph showing waveforms of control random signal 
Vc and detected signal Vs as inputs to the stochastic pulse generator 1. 
Note that Fig. 5(a) depicts the case where detected signal Vs is a constant 
voltage for easy understanding of the principle. 

25 Referring to Figs. 1 to 5, when control random signal Vc and 

detected signal Vs as shown in Fig. 5(a) are inputted to the comparator 3, 
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the comparator 3 outputs High voltage V ou t if the control random signal Vc 
is larger than the detected signal Vs or outputs Low voltage V ou t if the 
relation is converse, according to the characteristic of the comparator 3 
shown in Fig. 2. 

When voltage V ou t is inputted to the edge detector 7, the edge 
detector 7 outputs voltage Vp having pulses of a fixed width x when voltage 
Vout rises from Low to High. The counter 9 in turn counts the number of 
pulses of voltage Vp thus outputted. 

Based on the operation principle described above, pulses are 
randomly outputted according to detected signal Vs in the time domain in 
which a certain control random signal Vc is inputted, with the number of 
these pulses outputted corresponding to the magnitude of the detected 
signal Vs. 

However, it has been considered very difficult to control a 
stochastic device driven with such a random control signal Vc. This 
difficulty can be understood even from the fact that the conventional art 
cannot define noise. 

On the basis of following considerations, the inventor of the 
present inventions found a stochastic pulse generator driving method which 
is capable of statistically controlling the entirety of such a stochastic system 
by controlling the distribution density of random control signal Vc. 

Fig. 6 is a graph illustrating the principle of pulse number 
control. The stochastic pulse generator 1 according to this embodiment 1 
generates pulses when control random signal Vc makes transition from a 
state where it is smaller than detected signal Vs to a state where it is larger 
than detected signal Vs and counts these pulses. Fig. 6 depicts the case 
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where control random signal Vc is statistically controlled to have a 
distribution density represented by f(x). Note that the following 
description is directed to the case where detected signal Vs and control 
random signal Vc each take a value not less than 0(V) and not more than 
5 1(V). 

Referring for example to the case of Fig. 6 as an example of the 
pulse generation principle, when detected signal Vs takes a value 
represented by "Vs" on the horizontal axis (X-axis), an output of pulses is 
probable only in the case where control random signal Vc is present in 
10 domain A of Fig. 6 and then varies to a value within domain B. Therefore, 
the probability P can be calculated from the following formula* 

p _ Sa^b 

(s A + s B y 

wherein Sa and Sb represent the area of domain A and the area of domain B, 
respectively. Hereinafter, this formula will be referred to as formula (l). 
15 Note that 

S A +S B = { =0 f(x)dx = 1 

This formula will be referred to as formula (2). Therefore, from formula (l) 
and formula (2), it can be seen that 

P = S A S B =S A QS A ) 

20 Hereinafter, this formula will be referred to as formula (3). Substituting 
the value calculated from the formula (4)" 
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S A = £ Q f(x)dx 



into the formula (3) yields a pulse generation probability as a function of 
detected signal Vs. 

The next description is directed to an example of a method of 
5 creating a control random signal train which enables the statistic pulse 
generation probability (distribution density) to be known. 

Generally, random numbers which occur in a so-called 
programming language are random numbers having a statistically uniform 
distribution density in terms of magnitude. A method called inverse 
10 transformation can execute calculation, with the use of this uniform random 
numbers, for yielding random numbers having a distribution density of a 
function which is continuous as shown in Fig. 6 and of which integral 
function is calculable. 

The inverse transformation method includes finding any 
15 desired area S(x) by causing uniform random numbers of an interval [0, l] 
to occur and then finding x by integration from a so as to give an area equal 
to the area S(x). 

Uniform random numbers R are expressed by the formula* 



R = S(x)= f f(a)da 



20 Hereinafter, this formula will be referred to as formula (5). Solving the 
formula (5) for x can give random numbers in a desired form. 

The following description is directed to calculation for obtaining 
a distribution function of a quadratic function which becomes 0 when x = 0.5 
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and takes a maximum value when x = 0 and when x = 1. 

First, since the integral of the histogram is 1, the quadratic 
function is uniquely defined by the following formula (6)- 

p(x) = 3(1 - 2x) 2 

Substituting the formula (6) into the formula (5) yields the 

formula • 

R = S(x) = T {3(1- 2a) 2 }da 



Hereinafter, this formula will be referred to as formula (7). Assume that 
Xmin = 0, it follows that 



l-(l--2x) : 



Hereinafter, this formula will be referred to as formula (8). If the formula 
(8) is solved inversely, it follows that 

i 

l-(l-2#) 5 

x = 

2 

Hereinafter, this formula will be referred to as formula (9). 

Fig. 8 plots the function expressed by the formula (9). Fig. 9 
plots variations in value which occur when uniform random numbers are 
sequentially introduced into this function. As can be seen from Fig. 9, the 
value varies randomly. 
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Figs. 10(a) to 10(c) each show generation densities of generated 
values statistically interpreting random variations shown in Fig. 9. Note 
that Figs. 10(a) to 10(c) shows cases where uniform random numbers R are 
introduced 100 times, 1,000 times and 10,000 times, respectively. 
5 It is observed from Figs. 10(a) to 10(c) that the graph gradually 

approximates to the quadratic function shown in Fig. 3 as the number of 
times of introduction increases. It is therefore understood that the formula 
(6) results in an intended distribution density. 

As thus described, random numbers of a histogram having an 

10 intended distribution density can be obtained as long as the distribution 
density is an integrable function. Description is omitted of how to find a 
distribution function of which integral function is unknown by numerical 
calculations because it is not so difficult. Such a distribution function can 
simply be found by a similar operation of numerical calculations. One of 

15 the methods for such an operation is the rejection method for example. The 
rejection method includes randomly obtaining numbers satisfying the 
aforementioned conditions for a discontinuous function for example by 
numerical calculations and generating random numbers until the conditions 
are satisfied. 

20 As described above, it is possible to control the histogram 

(density distribution) of noise generated. Further, if the density 
distribution of noise is known, it is possible to find a probability at which 
the pulse generation probability varies according to the magnitude of 
detected signal Vs. 

25 By thus varying the density distribution of control random 

signal Vc it becomes possible to control the pulse generation probability 
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relative to the magnitude of detected signal Vs. 

This principle enables not only finding of a pulse generation 
probability in proportion to detected signal Vs but also flexible controls 
including- a control to lower the pulse generation probability sharply when 
5 control random signal Vc is lower than a certain value of detected signal Vs>" 
and a control to raise the pulse generation probability within a certain 
range of detected signal Vs. 

Particularly after these operations, processing is performed only 
for counting of generated pulses and, hence, execution of parallel operations 
10 by LSI is easy. 

It is needless to say that the control random signal so far 
described to be inputted to the stochastic pulse generator is not necessarily 
calculated by LSI. 

Specifically, it is possible to store a progression calculated 
15 following the aforementioned procedure in memory in advance and subject 
the progression to digital-analog conversion (D/A conversion) before input. 
Since control random signals Vc exhibit a stabilized histogram when the 
number of them is about 10,000 or more as apparent from Figs. 10(a) to 
10(c), it is sufficient to store 100,000 control random data for example. 
20 Even if 100,000 double precision data are to be stored, a necessary storage 
capacity is about 800 kByte (= 8 Byte x 100,000), which can easily be stored 
in recently -developed nonvolatile memory. Thus, this arrangement also 
allows desired controlled randomness to be exhibited. 

The present embodiment 1 has an arrangement to input 
25 detected signal Vs to one side of the comparator; however, it is needless to 
say that the pulse generation probability can be controlled similarly even 
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though the detected signal Vs has already contained a noise component as 
long as the profile of this noise component is known. Further, if control 
random signal Vcis turned into an optimum distribution function tailored to 
this profile, the pulse generation probability thereof can be optimized as in 
5 the foregoing description. 

Though the case where detected signal Vs is constant (DC) has 
been described in embodiment 1 for easy description, it is needless to say 
that even if detected signal Vs is a variable signal such as a periodic signal, 
pulses can be stochastically outputted relative to a signal value assumed at 

10 each time point. In this case, if the outputted pulses are subjected to 

Fourier transformation, a certain characteristic frequency can be identified. 

As described above, the stochastic pulse generator according to 
the present invention is capable of controlling the frequency of stochastic 
pulse generation corresponding to the magnitude of detected signal Vs by 

15 inputting feeble signal (detected signal Vs) having controlled distribution 

density and control random signal Veto one side and other side, respectively, 
of the comparator 3. 

Since this stochastic pulse generator is capable of controlling 
random signals, even if the detected signal has already contained noise, the 

20 pulse generator can extract the periodic component of the original detected 
signal efficiently by using random signals having a profile canceling the 
distribution density of the noise. 
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Embodiment 2 

Fig. 11 is a circuit diagram showing the configuration of 
stochastic pulse generator 51 according to embodiment 2 of the present 
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invention. Like reference characters are used to designate like elements 
throughout Figs. 1 and 11 for omission of description thereof. 

In the stochastic pulse generator 51 of Fig. 11 according to this 
embodiment, the output of comparator 3 is inputted to a low-pass filter 53, 
5 the output of which in turn is inputted to signal analyzer 55. The low-pass 
filter 53 has the function of allowing a frequency lower than a 
predetermined frequency to pass therethrough. The signal analyzer 55 
analyzes signals outputted from the low-pass filter 53 by performing 
frequency analysis such as Fourier transformation for example. 
10 Hereinafter, description will be made of the operation of the 

stochastic pulse generator of the configuration shown in Fig. 11 according to 
embodiment 2. 

The stochastic pulse generator of this embodiment 2 is different 
from the stochastic pulse generator of embodiment 1 and is characterized in 
15 that the output of the comparator 3 is further inputted to the low-pass filter 
53. In the following description, Vp designates the output of the 
comparator 3 and Vl designates the voltage resulting from passage of the 
output Vp through the low-pass filter 53. 

Figs. 12(a) to 12(e) are each a graph plotting the voltage which 
20 results at each of different portions of the stochastic pulse generator of Fig. 
11 when random numbers having a uniform distribution density are 
inputted as the control random signal. 

Fig. 12(a) shows the waveform of detected signal Vs, which is a 
sine wave of 1 kHz in this embodiment. Fig. 12(b) shows the waveform of 
25 control random signal Vc, which is controlled to have a uniform histogram of 
amplitude not shown. Fig. 12(c) shows the waveform of output voltage Vp 
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of the comparator 3. The output voltage Vp generates pulses each having a 
very short duration as shown in the figure as a result of comparison 
between sine wave detected signal Vs and control random signal Vc. 

While the case where the detected signal is constant has been 
5 described in embodiment 1, as seen from Fig. 12(c), the frequency of pulse 
generation varies as the value of detected signal Vs varies up and down. 

Figs. 12(d) and 12(e) each show the waveform of voltage Vl 
resulting from filtering of the pulsed output by the low-pass filter 53. Fig. 
12(d) is directed to the case where signals lower than 10 kHz are allowed to 
10 pass through the filter 53, while Fig. 12(e) directed to the case where signals 
lower than 2 kHz are allowed to pass through the filter 53. Note that there 
is a slight difference in tendency among Figs. 12(b) to 12(e) because signals 
in these figures are not obtained at the same time for convenience in 
obtaining signals. 

15 As can be seen from Fig. 12(e) in particular, an output 

waveform that is very similar to the characteristic of the feeble original 
signal can be obtained by blocking frequencies that are higher than but 
generally close to the characteristic frequency of the original detected signal. 

If this waveform is subjected to frequency analysis based on, for 

20 example, Fourier transformation by the signal analyzer 55, 1kHz which is 
the characteristic frequency of the detected signal can be observed very 
clearly. 

Unlike embodiment 1, embodiment 2 does not have edge 
detector 7 inserted downstream of the comparator 3. However, it is 
25 needless to say that the stochastic pulse generator of embodiment 2 will 
have essentially the same function even if the edge detector 3 is included. 
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A multiplicity of short" duration pulses are generated by varying control 
random signal Vc very rapidly relative to the frequency of detected signal Vs 
as shown in Fig. 12(c). Since any one of such pulses is blunted at the low- 
pass filter, the useful capability of accurate counting by the edge detector 7 
5 used in embodiment 1 cannot be expected to work well in embodiment 2. 

As described above, the stochastic pulse generator according to 
embodiment 2 blocks frequencies of the pulsed output from the comparator 
3 that are higher than the characteristic frequency of the detected signal to 
obtain the characteristic waveform of the original detected signal, thereby 

10 facilitating the signal analysis. 

It has been found that the pulse generation probability can be 
statistically controlled if the density distribution of control random signal 
Vc in particular is controlled. Further, as demonstrated in the foregoing 
description, it is possible to calculate the pulse generation probability from 

15 the density distribution of control random signal Vc as well as to obtain a 
desired density distribution of control random signal Vc. 

According to the principle thus described, embodiment 1 is 
capable of providing a stochastic pulse generator which can control the 
detection condition (pulse generation probability) of detected signal Vs by 

20 the use of control random signal Vc having a specific density distribution, as 
well as a driving method thereof. Even if detected signal Vs further 
contains a noise component, the use of control random signal Vc canceling 
the profile of the noise component makes it possible to extract the signal 
component of the detected signal Vs efficiently. 

25 The stochastic pulse generator according to embodiment 2 

passes the output of the comparator 3 through the low-pass filter 53 to 
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render the pulses blunt and hence is capable of detecting a characteristic 
frequency component of the detected signal more easily. 

Embodiment 3 

5 Fig. 14 is a circuit diagram showing an example of the 

configuration of a stochastic pulse generator according to embodiment 3 of 
the present invention. In Fig. 14, stochastic pulse generator 1 includes a 
variable signal generator 71 operative to generate a variable signal which is 
a kind of the control random signal used in embodiment 1, voltage 

10 converters 5a and 5b operative to convert variable signal Ss outputted from 
the variable signal generator 71 and a detected signal (hereinafter will be 
referred to as input signal) Sc to variable voltage Vc and input voltage Vs, 
respectively, using predetermined formulae and output the variable voltage 
Vc and input voltage Vs, and comparator 3 operative to compare the voltage 

15 signals outputted from respective of the voltage converters 5a and 5b and 

output voltage Vp of a pulse shape. This embodiment further includes edge 
detector 7 operative to detect the leading edge of the pulse shape of the 
output Vp of the comparator 3 and output pulses Vp of equal width, and 
counter 9 operative to count the number of the pulses Vp outputted from the 

20 edge detector 7 by detecting, for example, the leading edges of these pulses 
V P . 

The stochastic pulse generator 1 basically comprises the 
comparator 3, but is provided with the voltage converters 5a and 5b for the 
reason to be described later. 
25 Since the comparator 3, edge detector 7 and counter 9 each have 

the same configuration as the corresponding one used in embodiment 1 and 
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operate in the same manner as in embodiment 1, description thereof will be 
omitted. 

As shown in Fig. 15, the variable signal generator 71, which is a 
kind of control random signal generator 61 used in embodiment 1, has a 
5 processor 201 operative to execute an operation based on a predetermined 
formula represented as the function X n +i = f(Xn) for a variable X n inputted 
and output the resulting X n +i, and a delay circuit 202 operative to delay X n +i 
outputted from the processor 201 by a predetermined time and input the 
delayed X n +i to the processor 201. Thus, this configuration externally 

10 outputs a sequence of outputs X n +i from the processor 201 as variable signal 
Sc. The variable signal Sc will be described in detail later. 

In the stochastic pulse generator 1 according to this 
embodiment, the plus input terminal of the comparator 3 receives, as an 
input, the variable signal Sc or the variable voltage Vc converted by the 

15 voltage converter 5a, while the minus input terminal of the comparator 3 

receives, as an input, the input signal Ss to be expressed as stochastic pulses 
or the input voltage Vs converted by the voltage converter 5b. However, it 
is needless to say that a similar operation will result even in a reverse 
arrangement. 

20 Hereinafter, description will be made of the operation of the 

stochastic pulse generator 1 of the configuration shown in Fig. 14. 

When the variable voltage Vc and the input voltage Vs are 
inputted to the comparator 3 in the configuration shown in Fig. 14, pulses 
corresponding to input voltage Vs in a time domain in which the variable 

25 voltage Vc is inputted are outputted randomly, with the number of such 

pulses thus outputted corresponding to the magnitude of input voltage Vs. 
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This operation is the same as in embodiment 1. 

The following description is directed to the fact that the number 
of pulses counted by the counter 9 is stochastically indicative of the 
magnitude of input voltage Vs. 
5 Fig. 16 plots the number of pulses generated when the variable 

voltage Vc is varied 1,000 times with the input voltage Vs fixed to a value 
(within the range from 0 to 1 [V]) on the horizontal axis. In this case the 
variable voltage Vc varies according to uniform random numbers and the 
range of its variation is set to within the range from 0 to 1 [V]. 
10 As shown in Fig. 16, there is obtained the characteristic that 

the number of pulses varies like a quadratic function describing an 
upwardly projecting curve. Here, the conversion of input signal Ss to input 
voltage Vs by the voltage converter 5b of Fig. 14 is performed using, for 
example, the following formula (10)' 

15 V S = 0.4 X (S S - SsminMSsmax- S S min) ...(l0) 

wherein Ssmax and Ssmin represent a maximum value and a minimum value, 

respectively, of input signal Ss. 

The variable voltage Vc is a voltage converted with uniform 

random numbers within the range from 0 to 1 by a factor of 1. 
20 Then, input voltage Vs assumes a voltage from 0 to 0.4 [V]. 

Thus, an increasing number of pulses are counted as the magnitude of 

original input signal Ss increases, as shown in Fig. 16. 

That is, the stochastic pulse generator of the present invention 

can have the capability of converting the magnitude of input signal Ss to a 
25 number of pulses by means of the operation thus described. As can also be 

seen from Fig. 5 (embodiment l), a pulses count becomes more stochastic as 
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the number of variations in variable signal decreases. Therefore, 

decreasing the number of variations in variable signal will shorten the time 

required for a number of pulses to be obtained, but will enlarge the error. 

On the other hand, increasing the number of variations will reduce the error. 
5 Considerations will be given to the pulse generation probability 

relative to input voltage Vs in embodiment 3. 

Fig. 17 shows a histogram of the number of times of uniform 

random number generation in embodiment 3. As seen from Fig. 17, random 

numbers have a relatively flat and uniform distribution. 
10 Here, considerations are given again to the pulse generation 

conditions for the stochastic pulse generator of the present invention with 

reference to Fig. 18. 

As described above, pulse generation occurs under the 

conditions where Vc is smaller than Vs and the next Vc is larger than Vs (in 
15 the present arrangement). Assuming that Vc on a certain occurrence is 

Vc(t) and Vc on the next occurrence is Vc(t+l), the hatched area of the 

mapped space in Fig. 18 represents the pulse generation probability. 

Since Vc is uniform random numbers here, the probability of 

occurrence of a certain number is uniform in the range from 0 to 1. 
20 Therefore, the probability of the occurrence of Vc(t) in the range from 0 to Vs 

is Vs. Further, the probability of the occurrence of Vc(t+l) in the range 

from Vs to 1 is (l— Vs) and, as a result, the pulse generation probability P of 

the stochastic pulse generator of embodiment 1 is given by the following 

formula (ll)- 
25 P = Vs(l-Vs) ...(11). 

As understood from the above formula, the pulse generation 



30 

probability of the stochastic pulse generator of embodiment 3 is a quadratic 
function of Vs and, hence, the number of generated pulses shown in Fig. 16 
approximates to the quadratic function of the formula (11) by introduction of 
V c 1,000 times. 

5 As described above, the stochastic pulse generator 1 according 

to this embodiment, despite its simple circuit configuration, is capable of 
obtaining the magnitude of an input voltage in the form of a number of 
stochastic pulses by adjusting the variable voltage and the input voltage to 
respective optimum voltage values, inputting these values to the comparator 
10 to cause pulse generation to occur, and counting the generated pulses. 

By virtue of this function the stochastic pulse generator 1 is 
capable of expressing the magnitude of an input voltage in the form of a 
number of stochastic pulses directly without converting an analog signal to 
a digital signal. 

15 

Embodiment 4 

A stochastic pulse generator according to embodiment 4 of the 
present invention controls the variable signal to have a characteristic that is 
different from that of the stochastic pulse generator of embodiment 3, 
20 thereby obtaining another capability. Hereinafter, description will be made 
of this feature. 

The stochastic pulse generator according to this embodiment 4 
is characterized by the use of chaos of a tent map. Specifically, the 
processor 201 of the variable signal generator 71 shown in Fig. 15 performs 
25 an operation of a tent map to be described below and outputs variable signal 
Ss comprising chaos of the tent map. 
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First, description will be made of chaos of a tent map with 
reference to Fig. 19. 

Any desired initial value Xi is first selected in Fig. 19, and then 
a second value is determined according to the line using the following 
5 formulae (12) and (13) (mapping)' 

X 2 = 2Xi (Xi ^ 0.5) ...(12) 
X 2 = 2 (1-Xi) (Xi > 0.5) ...(13) 

Subsequently, from the value of X2 thus obtained, X3 is found 
using again the formulae (12) and (13). Tent map chaos can be obtained by 
10 such a simple mapping operation. However, a progression obtained in this 
manner is known to exhibit very complicated behavior in a long term. 

The pulse generation probability that is given when such tent 
map chaos is used as the variable signal Ss will be examined using Fig. 20. 

Like uniform random numbers in embodiment 3, tent map 
15 chaos has been mathematically demonstrated to have a constant histogram. 
Therefore, the following analysis holds. 

For the same reason as stated in embodiment 1 the hatched 
areas in respective of Figs. 20(a) and 20(b) each determine the pulse 
generation probability in each case. 
20 The difference from embodiment 3 resides in that since the 

value on the second occurrence is determined from a map in this 
embodiment, each of the hatched areas in Fig. 20 does not represent the 
pulse generation probability, but pulse generation is possible only in the 
ranges indicated by thick lines in Fig. 20. That is, each of widths P 
25 indicated by respective arrows represents the pulse generation probability. 

As shown in Fig. 20, the following two different calculation 
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formulae are used to find width P depending on whether Vs is larger than or 
smaller than 2/3. 

P = V s /2 (V s ^ 2/3) ...(14) 

P= 1-Vs (V s ^ 2/3) ...(15) 
5 The outcome of calculation of the pulse generation probability 

by these formulae (14) and (15) is shown in Fig. 21. 

If the voltage converter 5a shown in Fig. 14 is controlled so that 
Vs may range from 0 to 2/3 (range A in the figure) for example as in 
embodiment 3, the stochastic pulse generator 1 of this embodiment 4 can 
10 obtain a linear pulse generation characteristic relative to the value of input 
signal Ss as an exact solution and the pulse generation probability is seen to 
fall within the range from 0% to 33%. 

As can be understood from the above description, the stochastic 
pulse generator of this embodiment 4 is capable of obtaining a number of 
15 pulses which is linear relative to input signal Ss as an exact solution (if the 
variable signal is varied numerous times). 

That is, the stochastic pulse generator is capable of turning the 
analog value of an input signal into a linear pulse generation probability. 
Thus, it becomes possible to calculate an absolute difference between pulse 
20 generation probabilities relative to different input signals simply as a 
difference in the number of pulses. 

Though description has been directed to the case where range A 
in Fig. 21 is used in embodiment 4, it is needless to say that the use of range 
B will result in a similar effect. 
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Embodiment 5 

A stochastic pulse generator according to embodiment 5 of the 
present invention is characterized by the use of a progression called 
"Bernoulli shift" as the variable signal, unlike the stochastic pulse generator 
5 of embodiment 4. Specifically, the processor 201 of the variable signal 
generator 71 shown in Fig. 15 executes an operation using a progression 
called "Bernoulli shift" to output variable signal Ss. 

Description will be made of a Bernoulli shift map with reference 

to Fig. 22. 

10 Any desired initial value Xi is first selected in Fig. 22, and then 

a second value is determined according to the line using the following 
formulae (16) and (17): 

X 2 = 2Xi (Xi ^ 0.5) ...(16) 
X 2 = 2Xi-l (Xi ^ 0.5) ...(17) 
15 Subsequently, from the value of X2 thus obtained, X3 is found 

using again the formulae (16) and (17). Such a simple mapping operation 
is repeated as in embodiment 4. The Bernoulli shift map also generates a 
progression of a uniform histogram. 

Thus, as in embodiment 4, the pulse generation probability of 
20 the stochastic pulse generator according to this embodiment 5 can be 

obtained as shown in Figs. 23(a) and 23(b). The ranges indicated by the 
thick lines on the maps in Figs. 23(a) and 23(b) represent pulse generation 
probabilities and are calculated by the formulae ' 
P = V s /2 (V S ^ 0.5) ...(18) 
25 P = (l-V s )/2 (V s ^ 0.5) ...(19) 

The outcome of calculation of the pulse generation probability 
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by these formulae (18) and (19) is shown in Fig. 24. Like embodiment 4, 
this embodiment 5 can obtain a linear pulse generation probability 
characteristic that has a peak when Vs = 0.5. 

If the voltage converter 5a shown in Fig. 14 is controlled so that 
5 input voltage Vs may range from 0 to 0.5 (range C in the figure) for example, 
the stochastic pulse generator of this embodiment 5 can obtain a linear 
pulse generation characteristic relative to the value of input signal Ss as an 
exact solution and the pulse generation probability is seen to fall within the 
range from 0% to 25%. 
10 That is, the stochastic pulse generator of this embodiment 5 is 

also capable of turning the analog value of an input signal into a linear 
pulse generation probability. 

It is needless to say that the use of range D will result in a 
similar effect. 

15 In each of the foregoing embodiments 3 to 5, description has 

been made of the cases where pulse generation is caused to occur using 
uniform random numbers, a tent map or a Bernoulli shift map as the 
variable signal. As can be understood from the description of these 
embodiments, it is needless to say that the variable signal need not 

20 necessarily be obtained by calculation, but the use of, for example, an 

amplified noise signal results in a similar operation. Such a noise signal, 
in particular, is preferably has a known histogram. A noise signal having a 
stable histogram shape is more preferable in terms of easiness in 
determining calculations for voltage conversion to a signal voltage. 
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Embodiment 6 

A stochastic pulse generator according to embodiment 6 is 
characterized by the use of a chopper type comparator as the comparator. 

The chopper type comparator (hereinafter will be referred to as 
5 "Cc") is a circuit for use in analog- digital conversion or the like. Since Cc is 
capable of canceling variations in transistor threshold, Cc is a very useful 
circuit in CMOS in particular. In prospect of the incorporation of a 
stochastic pulse generator into a silicon semiconductor, the ability to form 
and drive a stochastic pulse generator with the use of Cc is highly 
10 industrially effective. 

Fig. 25 is a circuit diagram showing the configuration of the 
stochastic pulse generator of embodiment 6. Like reference characters are 
used to designate like parts throughout Figs. 14 and 25 for the purpose of 
omitting the description thereof. In Fig. 25, stochastic pulse generator 20 
15 of this embodiment 6 has a comparator 21 including Cc comprising a 

capacitor, an inverter and a switch (MOS transistor for example). Variable 
voltage Vc and input voltage Vs outputted from voltage converters 5a and 5b 
are inputted to the comparator 21 through switches 23a and 23b, 
respectively. The switches 23a and 23b each comprise a MOS transistor for 
20 example. 

Figs. 26(a) and 26(b) are diagrams illustrating the operation of 
Cc. In the operation, voltage Vi is applied to Cc with switch SW in a short- 
circuited state as shown in Fig. 26(a) and then switch SW is turned OFF, 
followed by application of V2 as shown in Fig. 26(b). If V2 is larger than Vi, 
25 the inverter performs inversion to output V ou t assuming Low. On the other 
hand, if V2 is smaller than Vi, the inverter outputs V ou t assuming High. In 
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this way, Cc can compare voltages as to their respective magnitudes by 
turning switch SW ON/OFF to allow the voltages to be inputted sequentially. 

In this example, V ou t assumes High first and then inverted to 
assume Low. This operation is not essential. If, for example, an 
5 additional inverter is provided at the output terminal, High and Low can be 
reversed. 

Fig. 27 is a diagram illustrating the operation of the stochastic 
pulse generator according to this embodiment 6. 

As shown in Fig. 27(a), first, switch 23a and switch 23b in the 

10 stochastic pulse generator 20 are turned OFF and ON, respectively, while 
switch SW of the comparator 21 comprising Cc is also turned ON. In 
response thereto, the voltage converter 5b converts input signal Ss to input 
voltage Vs based on the formulae described in embodiments 3 to 5, and the 
resulting input voltage Vs is applied to the comparator 21 via switch 23b. 

15 Thereafter, the switch SW of the comparator 21 is turned OFF, so that Vs is 
written to Cc. 

Subsequently, as shown in Fig. 27(b), the switch 23b and switch 
23a are turned OFF and ON, respectively. In response, variable signal Sc 
is converted to variable voltage Vc by the process described in embodiments 

20 3 to 5, and the resulting variable voltage Vc is applied to the comparator 21 
via switch 23a. The comparator 21, in turn, outputs High/Low signal V ou t, 
which is then converted to pulses Vp of equal width by edge detector circuit 
7, and counter 9 counts these pulses. 

Fig. 28 is a graph showing an operating state of the stochastic 

25 pulse generator of this embodiment 6. In Fig. 28, the horizontal axis and 
the vertical axis represent time and a voltage of l[V/div], respectively, and 
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the graphs plot input voltage Vs, variable voltage Vc, and comparator 
output V 0 ut in the ascending order. 

The switch SW of the comparator 21 opens and closes to write a 
signal voltage Vs of 0.5 [V] during an initial period of 10 to 30 [nsec]. 
5 Thereafter, variable voltages Vc are sequentially applied from a point of 
time at 50 [nsec]. 

In this example, voltages according to a progression generated 
by tent map chaos are applied. 

Since the High/Low output of Cc is inverted, the output V ou t 
10 assumes High when Vc is smaller than Vs which is written first. When Vc 
lowers from a value higher than 0.5 [V] to a value lower than 0.5 [V] in Fig. 
28, the output V ou t changes over to High. If the edge detection described in 
embodiment 3 is conducted thereafter, it is possible to detect the edge of V ou t 
assuming High as well as to obtain the number of pulses corresponding to 
15 the value of Vs, though detailed description of this operation is omitted here. 

Since the stochastic pulse generator of this embodiment 6 is 
capable of performing successive comparing operations by means of 
comparator 21 by simply varying variable signal Sc to one value after 
another in the state shown in Fig. 27(b) in particular, the value of input 
20 signal Ss can be converted to a number of stochastic pulses by a very simple 
driving method. Specifically, if variable signal Sc is generated according to 
the tent map chaos used in embodiment 4 for example, the number of pulses 
counted by the counter 9 linearly expresses the magnitude of the variable 
signal Sc in the form of stochastic pulses. 



25 



38 



Embodiment 7 

A stochastic pulse generator according to embodiment 7 of the 
present invention is different from those of embodiments 3 to 6 in the 
manner of inputting variable signal Sc. 
5 In the description of the stochastic pulse generator in each of 

embodiments 3 to 6, variable signal Sc has been simply described to be 
uniform random numbers or a map progression and, hence, the value of 
variable signal Sc is not mentioned specifically. 

The stochastic pulse generator according to embodiment 7 is 
10 characterized in that the same progression is applied every time as variable 
signal Sc- 

Such a progression can be obtained by storing generated 
uniform random numbers into a storage device and using the stored uniform 
random numbers from the initial number every time. In the case where a 
15 map such as a tent map or a Bernoulli shift map is used, fixing the initial 
value enables the same progression to be obtained every time by at least a 
digital operation if any operation error dose not occur. In this embodiment 
7, the variable signal generator 71 shown in Fig. 14 is configured to perform 
such an operation. 

20 Fig. 29 plots pulse generation probabilities obtained by use of 

the same progression every time and by the use of complete random 
progression, respectively, any of the progressions being a tent map 
progression as used in embodiment 4. 

The horizontal axis represents signal voltage Vs and the 

25 vertical axis represents pulse generation probability P. This graph plots 
the pulse generation probabilities obtained in an exemplary case where Vs 
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is increased little by little from 0.8 and variable voltage Vc is varied 100 
times for each value of Vs. 

The stochastic pulse generator according this embodiment 7 
uses a variable voltage generated according to a tent map and operates so 
5 that the pulse generation probability becomes 1/3 as a maximum value 
when Vs = 1 for example, as in embodiment 4. However, since the pulse 
generation probability P is stochastic to the end, some deflection is found 
relative to complete random variable signals as seen from Fig. 29. This 
means that Vs does not necessarily assume the maximum when P assumes 
10 the maximum. 

However, when P was obtained relative to each Vs using the 
same progression as the variable signal every time, the inventor of the 
present invention found that P varied stepwise as shown in Fig. 29 and 
exhibited the characteristic that P generated such that a maximum Vs was 
15 included in Vs values assumed when P was at the maximum. 

This is because the use of the same progression results in 
comparison between the same Vc group and the same Vs group every time 
and hence at least a decrease is not possible in the pulse generation 
probability obtained when Vs becomes large. 
20 As described above, the stochastic pulse generator of this 

embodiment is capable of substantially varying its operation by a simple 
control such as to render variable signals same or different every time 

With progressions based on mapping in particular, a control to 
provide such a large variation in operation can be achieved by merely fixing 
25 or unfixing the initial value of the progression used. 

With complete random control signals, the pulse generation 
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probability P exhibits the characteristic that P is randomly extracted from a 
relatively large Vs group just stochastically. If such a random 
characteristic is utilized in Manhattan distance processing for vector 
matching, a certain vector is randomly extracted from proximate ones. 
5 Such an operation is useful when a device is to be configured to perform an 
operation giving no "boredom" to humans for example. 

On the other hand, inputting variable signals of the same 
progression is a very useful operation method when an accurate operation is 
required such that when the proximity of a certain number to a very large 
10 number of variables is to be found, variables proximate to the certain 

number is extracted from a group of variables to reliably include at least a 
correct variable therein. 



Embodiment 8 

15 Fig. 30 is a circuit diagram showing the configuration of an 

absolute difference processor according to embodiment 8 of the present 
invention. 

In Fig. 30, reference character 30 designates the absolute 
difference processor. Reference characters 31a and 31b each designate a 

20 stochastic pulse generator as described in embodiments 3 to 7. The 
stochastic pulse generators 31a and 31b are each the same as in 
embodiment 3 in that the stochastic pulse generator 31a includes variable 
signal generator 71, comparator 32a and voltage converters 33a and 33b and 
the stochastic pulse generator 31b includes variable signal generator 71, 

25 comparator 32b and voltage converters 33c and 33d. However, the two 
stochastic pulse generators 31a and 31b share the single variable signal 
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generator 71. The outputs of respective comparators 32a and 32b are 
V 0 uti(Voi) and V ou t2(Vo2), respectively, which are inputted to edge detector 
circuits 35a and 35b, respectively. The outputs Vpi and Vp2 of the 
respective edge detector circuits 35a and 35a are inputted to XOR 
5 (exclusive -OR) circuit 36, the output terminal of which is connected to 
counter 37. 

The absolute difference processor according to this embodiment 
6 provides the operation of generating stochastic pulses corresponding to the 
absolute difference between two input signals (Ssi and Ss2) that are present 
10 therein. 

As shown in Fig. 30, one input signal Ssi is inputted to the 
stochastic pulse generator 31a, while the other input signal Ss2 inputted to 
the stochastic pulse generator 31b. On the other hand, the same variable 
signal Sc is inputted to both of the stochastic pulse generators 32a and 32b. 
15 The operation of the absolute difference processor thus 

configured will be described with reference to Fig. 31. 

Fig. 31 is a graph plotting the outputs of respective edge 
detector circuits 35a and 35b resulting when the same signals Sc are given 
with respect to two input signals Ssi and Ss2 and the output of the XOR 
20 circuit resulting when the outputs of detector circuits 35a and 35b are 
inputted thereto. 

In embodiment 8, description is made of the case where there 
are used stochastic pulse generators according to embodiment 4. 

As shown in Fig. 31, the stochastic pulse generators 31a and 
25 31b generate pulses Vpi and Vp2, respectively, according to embodiment 4, 
with probabilities corresponding to the magnitudes of respective input 
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voltages Vsi and Vs2 every time the variable voltage Vc is varied. 

Since the same signal Vc is inputted to the two stochastic pulse 
generators 31a and 31b, the pulse generators 31a and 31b generate pulses 
simultaneously at many occasions if the values of respective input voltages 
5 Vsi and Vs2 are close to each other. Accordingly, Low is outputted after 
XOR operation in many cases. 

On the other hand, if only one of the pulse generators 
(stochastic pulse generator 31b in this case) generates pulse, pulses are 
outputted after the XOR operation. 

10 That is, as the values of respective voltages Vsi and Vs2 become 

closer to each other, pulses Vpi and Vp2 are generated more similarly and 
consequently, an output of pulse occurs after the XOR operation with a 
lowering probability. On the other hand, as the values of respective 
voltages Vsi and Vs2 differ from each other more largely, the probability that 

15 either of pulses Vpi and Vp2 is generated becomes higher and consequently, 
an output of pulse occurs after the XOR operation with an increasing 
probability. 

As can be understood from the above description, the absolute 
difference processor 30 shown in Fig. 30 outputs pulse with a lowering 
20 probability as the values of respective input voltages Ssi and Ss2 become 

closer to each other; that is, the absolute difference processor stochastically 
outputs pulses corresponding to an absolute difference Ssi"Ss2. 

Fig. 32 is a graph showing the outcome of the operation of the 
absolute difference processor according to embodiment 8. 
25 In Fig. 32, the horizontal axis represents the absolute difference 

between two input signals generated randomly and the vertical axis 



43 



represents the number of pulses generated in the case where the variable 
signal is varied 1,000 times (completely randomly). 

As shown, the absolute difference can be expressed as a number 
of stochastic pulses having a very good linear characteristic. 
5 As described above, the absolute difference processor of this 

embodiment 8 is capable of stochastically obtaining pulses corresponding to 
an absolute difference by the operations including* inputting two input 
signals to respective of the two stochastic pulse generators, inputting the 
same variable signal to the two stochastic pulse generators, and executing 
10 an XOR operation for the outputs of the respective pulse generators. 

It is needless to say that the pulse generation probability 
relative to an absolute difference can be varied stepwise by the use of the 
same progression as the variable signal as in embodiment 7. 

15 Embodiment 9 

Embodiment 9 of the present invention is an example of a 
Manhattan distance processing apparatus. 

Fig. 33 is a circuit diagram showing the configuration of the 
Manhattan distance processing apparatus according to embodiment 9. 

20 In Fig. 33, Manhattan distance processing apparatus 41 has n 

absolute difference processors 43(l) to 43(n). Variable signal Sc is inputted 
to the absolute difference processors 43(1) to 43(n) from shared variable 
signal generator 50. Further, input signals Ssi(l) to Ssi(n) and input 
signals Ss2(l) to Ss2(n), which correspond to elements of two vectors 46 and 

25 48, are inputted to the absolute difference processors 43(l) to 43(n). The 
output terminals of the respective absolute difference processors 43(l) to 
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43(n) are connected to common wiring 52a having one end connected to 
counter 52. The wiring 52a is provided with delay circuits 45(l) to 45(n— l) 
each located intermediate the connecting portions between the output 
terminals of each pair of adjacent absolute difference processors and the 
5 wiring 52a. 

The vector 46 has n elements and comprises n values (signals) 
47(1) to 47(n) corresponding to these elements. The other vector 48 has n 
elements and comprises n values (signals) 49(l) to 49(n) corresponding to 
these elements. 

10 The delay circuits 45(l) to 45(n-l) of this embodiment 9 each 

have a delay time twice as long as delay time x of the delay circuit described 
in embodiment 3. 

Description will be made of the operation of the Manhattan 
distance processing apparatus thus configured according to embodiment 9 

15 with reference to Fig. 33. 

Signals Ssi(i) and Ss2(i) having the same element number as the 
vectors 46 and 48 are inputted to the absolute difference processor 43(i). 

In response thereto, input voltages Vsi and Vs2 according to 
respective input signals Ssi(i) and Ss2(i) are inputted to the associated 

20 comparator, as in the operation of the absolute difference processor of 
embodiment 8. All the absolute difference processors 43(1) to 43(n) 
perform the aforementioned operation. As a result, in response to a certain 
variable signal Sc inputted from the variable signal generator 50 to each of 
the absolute difference processors 43(1) to 43(n), the absolute difference 

25 processors 43(l) to 43(n) each output pulse with a probability proportional 
to the Manhattan distance between Ssi(i) and Ss2(i). 
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The pulse thus outputted reaches the counter 52 via each delay 
circuit 45. Since the delay time of each delay circuit 45 is 2x , which is 
twice as long as pulse width x in this embodiment 9, the pulses outputted 
from respective absolute difference processors 43(l) to 43(n) reach the 
5 counter 52 without overlapping each other in terms of time, whereby the 
counter 52 can count the number of the pulses accurately. 

After lapse of a time period for counting all the pulses, varying 
the variable signal Sc allows pulse generation to occur in the same manner. 
The operation thus described causes each of the absolute 
10 difference processors to generate pulses corresponding to the absolute 
difference between vector elements in each pair. For this reason, the 
Manhattan distance processing apparatus of this embodiment 9, as a whole, 
can obtain the number of pulses corresponding to the Manhattan distance 
between the two vectors at the counter 53. 
15 It is needless to say that parallel expansion of such a structure 

will enable matching between an input vector and an enormous number of 
reference vectors in the same manner as described above. 

By virtue of such a Manhattan distance processing apparatus, a 
vector matching operation, which would otherwise require a very lengthy 
20 time and much energy in the case of digital operation, can be executed at 
lower power consumption. 

In this embodiment 9 particularly, since the same variable 
signal is inputted to all the absolute difference processors, the apparatus 
assures that vectors having the shortest Manhattan distance are necessarily 
25 included in a group of vectors having the lowest pulses count, which is 
obtained when the numbers of pulses counted by the counter 52 are 
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compared to each other, owing to the same effect as obtained by the 
inputting of the same progression described in embodiment 5. 

Thus, even when an enormous number of vector columns 
(reference vectors ) are present, the Manhattan distance processing 
5 apparatus of the present invention can substantially reduce the number of 
selected vector columns because the selected vector columns include a 
correct vector. Thus, even though a digital operation for example is 
required for precise Manhattan distance processing after the processing by 
the apparatus of the present invention, higher-speed Manhattan distance 
10 processing can be realized at lower power consumption, with all things 
considered. 

While this embodiment 9 uses the delay method for allowing 
pulses simultaneously outputted from the respective absolute difference 
processors to be counted, it is needless to say that another method such as 

15 to charge capacitors with the pulses can provide the same capability 
Summary of Embodiments 3 to 9 

As described above, the present invention is directed to the 
configuration of a stochastic pulse generator, a variable signal for use in the 
operation thereof, an absolute difference processor employing the stochastic 

20 pulse generator, and an intervector Manhattan distance processing 
apparatus employing the absolute difference processor. 

The stochastic pulse generator of the present invention, despite 
its simple circuit configuration, is capable of obtaining a number of 
stochastic pulses corresponding to the magnitude of an input signal by 

25 converting a variable signal and the input signal to respective optimum 
voltage values, inputting these values to the comparator to cause pulse 
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generation to occur, and counting the generated pulses. By virtue of this 
capability the stochastic pulse generator provide for a device which is 
capable of directly expressing the magnitude of an analog signal as a 
number of stochastic pulses without converting the analog signal to a digital 
5 value. 

The use of a variable signal based on tent map chaos or 
Bernoulli shift map for controlling the pulse generation of this stochastic 
pulse generator is particularly effective in view of the characteristic that the 
pulse generation probability linearly corresponds to the input signal. Thus, 

10 the characteristics of the stochastic pulse generator can be controlled more 
effectively. Since the capability can be provided of converging the input 
signal into a pulse generation probability proportional to the value or 
magnitude of the input signal by merely increasing the number of variations 
of the variable signal without any particular need of other complicated 

15 control, a precision of calculation is ensured in processing for comparison 
between a number of pulses and another number of pulses after the pulses 
counts have been obtained. Thus, a highly useful capability can be 
provided. 

Also, description has been made of the feature that the 
20 randomness in the number of pulses generated can be controlled based on 
whether the variable signal comprises complete random signals or the same 
progression is used as the variable signal at least for every input signal. 
Notwithstanding the fact that such a control is very simple, the use of the 
same progression, in particular, can assure that a group of largest pulses 
25 counts necessarily includes the largest input signal without inversion of 

each number of pulses when input signals are compared to each other as to 
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their magnitude. The use of the same progression is particularly effective 
when the largest or smallest value is extracted by a mathematical operation 
such as absolute difference processing or Manhattan distance processing. 

On the other hand, the use of complete random progression 
enables random extraction of a value or vector proximate to a certain value 
or vector from a group of proximate ones in the case where selection of the 
same thing is not preferred, for example, in the case of vector matching of 
information about human's emotion. 

The absolute difference processor employing such a stochastic 
pulse generator is capable of generating pulses corresponding to an absolute 
difference, despite its simple structure comprising two stochastic pulse 
generators and an XOR logic circuit. The absolute difference processor is 
very useful from the viewpoint of the advantage that the configuration of a 
Manhattan distance processing apparatus employing this absolute 
difference processor in particular can be simplified. 

The Manhattan distance processing apparatus according to the 
present invention is capable of drastically reducing the amount of 
operations required to be performed by digital LSI and hence is of great 
industrial contribution by virtue of its capability of reducing the number of 
proximate vectors in view of the situation of the present digital LSI society 
where the amount of information processing for finding vectors that are the 
closest to or the most distant from each other, such as MPEG image 
compression, image recognition or voice recognition, is becoming enormous. 

It will be apparent from the foregoing description that many 
improvements and other embodiments of the present invention occur to 
those skilled in the art. Therefore, the foregoing description should be 
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construed as an illustration only and is provided for the purpose of teaching 
the best mode for carrying out the present invention to those skilled in the 
art. The details of the structure and/or the function of the present 
invention can be modified substantially without departing from the spirit of 
5 the present invention. 

Industrial Applicability 

The stochastic pulse generator according to the present 
invention is useful as an industrially-applicable stochastic pulse generator. 
10 The absolute difference processor according to the present 

invention is useful as an absolute difference processor for use in a 
Manhattan distance processing apparatus and the like. 

The Manhattan distance processing apparatus according to the 
present invention is useful as a Manhattan distance processing apparatus 
15 for use in an information processing apparatus and the like. 

The stochastic pulse generator driving method according to the 
present invention is useful as a driving method for an industrially- 
applicable stochastic pulse generator. 



